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Multi-Agent Systems 
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Abstract 

In this work, an Hao performance fault recovery control problem for a team of multi-agent systems 
that is subject to actuator faults is studied. Our main objective is to design a distributed control 
reconfiguration strategy such that a) in absence of disturbances the state consensus errors either remain 
bounded or converge to zero asymptotically, b) in presence of actuator fault the output of the faulty 
system behaves exactly the same as that of the healthy system, and c) the specified Hao performance 
bound is guaranteed to be minimized in presence of bounded energy disturbances. The gains of the 
reconfigured control laws are selected first by employing a geometric approach where a set of controllers 
guarantees that the output of the faulty agent imitates that of the healthy agent and the consensus 
achievement objectives are satisfied. Next, the remaining degrees of freedom in the selection of the 
control law gains are used to minimize the bound on a specified Hao performance index. The effects of 
uncertainties and imperfections in the FDI module decision in correctly estimating the fault severity as 
well as delays in invoking the reconfigured control laws are investigated and a bound on the maximum 
tolerable estimation uncertainties and time delays are obtained. Our proposed distributed and cooperative 
control recovery approach is applied to a team of five autonomous underwater vehicles to demonstrate 
its capabilities and effectiveness in accomplishing the overall team requirements subject to various 
actuator faults, delays in invoking the recovery control, fault estimation and isolation imperfections and 
unreliabilities under different control recovery scenarios. 


I. Introduction 

Utilization of unmanned vehicles (agents) in operations where human involvement is danger¬ 
ous, or impossible as in deploying mobile robots for planetary surface exploration, autonomous 
underwater vehicles for surveying deep sea, among others, has recently received extensive interest 
by the research community. In addition, deployment of multiple vehicles such as spacecraft, 
mobile robots, or unmanned underwater vehicles instead of using a single vehicle increases the 
system performance and reliability, while it will ultimately reduce the cost of the overall mission. 
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In safety critical missions, the agents should have the capability to cope with unexpected 
external influences such as environmental changes or internal events such as actuator and sensor 
faults. If these unexpected events are not managed successfully, they can lead to the team 
instability or cause sever overall team performance degradations. For example, the crash of 
the NASA’s DART spacecraft in 2006 was due to a fault in its position sensors [|^. 

The development of control reconfiguration for multi-agent systems is distinct from the control 
design problem of healthy multi-agent systems Q, [211, p^, [28 j. This is so in the sense that 


the former should be ideally solved on-line and use only local information given that faults 
occur at unknown times, have unknown patterns, and the existing fault detection and isolation 
(FDI) module in the team information may be available only locally, while the latter problem 
can be solved off-line and by potentially using the entire system information. Moreover, due to 
the information sharing structure of multi-agent systems, the fault tolerant control approaches 
that have extensively been studied in the literature for single agent systems [?], [14|, & 
pOl will not be directly applicable to multi-agent systems. 

Recently, the control reconfiguration problem of multi-agent systems has been studied in [[2, 
0, @, [(Tg, [(Tg, [[Tg, in g, @, formation flight problem 

in a network subject to loss of effectiveness (LOE) faults is considered and in Q, [ fT0| , [ [^ the 
consensus achievement problem in faulty multi-agent systems is studied. In [25[, a discrete-event 
supervisory module is designed to recover the faults that cannot be recovered by the agents using 
only local recovery solutions. In 0, a high-level performance monitoring module is designed that 
monitors all the agents and detects deviations of the error signals from their acceptable ranges. 
This module would then activate a high-level supervisor to compensate for the deviations in the 
performance specifications due to limitations of the low-level recovery strategy. In 0, [ [26| , [ |27| , 
adaptive control approaches are employed to compensate for actuator faults and in [ fig , 
control reconfiguration problem in a team of Euler Eagrange systems subject to actuator 


faults and environmental disturbances is studied. Einally in [13|, [29[, attitude synchronization 
problem for a team of satellites in presence of actuator faults is studied. 

In this work, Hao performance control reconfiguration problem in multi-agent systems subject 
to occurrence of three types of faults, namely, the loss of effectiveness (EOE), stuck and outage 
faults is studied. The proposed ifoo-based control reconfiguration strategy guarantees that the 
faulty agent outputs imitate those of the healthy system while the state consensus errors are 
either ensured to be asymptotically stable or remain bounded in absence of disturbances and 
the disturbance attenuation bound is minimized when the disturbances exist. Eurthermore, this 
approach can compensate for the outage and stuck faults which cause rank deficiency and change 
the agent structure, whereas in the adaptive approaches it is assumed that the fault does not cause 
rank deficiency. 


Our proposed approach is similar to the works in [lOj, [33|, but it has the following distinc- 
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tions, namely: (i) in [331 it is assumed that all the followers have aeeess to the leader input signal 


while in this work we do not require this assumption, (ii) in [33| environmental disturbanees 
have not been eonsidered whereas in this work we do inelude disturbanees in our analysis and 
design, (iii) in this work agents eould be subjeet to simultaneous LOE, outage and stuek faults, 
however in [ |T0| only a single LOE fault has been studied and in [33 j only LOE and outage faults 
have been eonsidered, (iv) in both [ fT0| , the network topology is assumed to be indireeted 
whereas in this work we have eonsidered a direeted network topology, and (v) in this work we 
ensure that the outputs of the faulty agent are exaetly foreed to follows those of the healthy agent 


and the state eonsensus errors remain bounded, whereas in [10[, [33| the eonsensus problem is 
eonsidered. The main motivation for enforeing outputs of the agents outputs to follow that of the 
leader is that in some applieations like small light weight under vehieles, a small deviation in 
the speed ean eause a big deviation in the agent position whieh may eause the network beeome 
diseonneeted or the agent beeomes lost. In order to reaeh this objeetive, we formulated the 
problem as disturbanee deeoupling problem with stability and we use the Geometrie approaeh 
Q and eontrolled invariant subspaees to solve the problem along with linear algebra and matrix 
theory to address exaet output following and state eonsensus error stability in the team as well 
as disturbanee attenuation. To the best of our knowledge this problem has not been eonsidered 
in the eurrent literature in multi-agent systems. 

In view of the above diseussion, the main eontributions of this work ean be summarized as 
follows: 

1) A distributed eontrol reeonfiguration strategies for multi-agent systems subjeet to LOE, 
outage and stuek faults are proposed and developed. Towards this end, assoeiated with eaeh 
agent a novel “virtual auxiliary system” is eonstrueted for the first time in the literature. 
Eaeh agent will reeeive information from only the states of its assoeiated auxiliary agent 
and the nearest neighboring auxiliary agents. This is in eontrast with eonventional eoop- 
erative sehemes where eaeh agent will be reeeiving the aetual state information from its 
nearest neighboring agents. The proposed strategy guarantee an H^o performanee eontrol 
reeonfiguration with stability. 

2) The proposed reeonfiguration eontrol laws guarantee that the output of the faulty agent 
behaves the same as that of the healthy system, and moreover a speeified Hoc performanee 
index is minimized in presenee of environmental disturbanees. 

3) The effeets of uneertainties and imperfeetions in the EDI module deeision in eorreetly 
estimating the fault severity as well as delays in invoking the reeonfigured eontrol laws 
are investigated and a bound on the maximum tolerable estimation uneertainties and time 
delays are obtained. 

4) The proposed distributed reeonfiguration eontrol laws are eapable of and designed speeifi- 
eally for aoeommodating single, eoneurrent and simultaneous aetuator faults in multi-agent 
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systems. 

The remainder of this work is as follows. In Seotion|I^ the required baekground information are 
provided and the problem is formally defined. In Seetion ITO the proposed reeonfigured eontrol 
law and the effeets of uneertainties on the proposed solution are investigated. In Seetion the 
proposed eontrol laws are applied to a network of Autonomous Underwater Vehieles (AUV)s and 
extensive simulation results and various ease studies are studied and presented. Finally, Seetion 
|V] eoneludes the paper. 


II. Background and Problem Definition 

A. Graph Theory 

The eommunieation network among + 1 agents ean be represented by a graph. A direeted 
graph Q = {V,£) eonsists of a nonempty finite set of vertiees V = {t’oj'yi, and a finite 

set of ares C V x V. The i-th vertex represents the Ath agent and the direeted edge from i to 
j is denoted as the ordered pair (i, j) G 8, whieh implies that agent j reeeives information from 
agent i. The neighbor set of the Ath agent in the network is denoted by Mi = ^ ^}- 

The adjaeeney matrix of the graph Q is given by G = [gtj] G where pij = 1 if 

j ^ Mi, otherwise Pij = 0. The Laplaeian matrix for the graph Q is defined as L = D — G, 
where D = diag{di} and di = Yl^^odij- 


B. Leader-Follower Consensus Problem in a Network of Multi-Agent Systems 

The main objeetive of the eonsensus problem in a leader-follower (LF) network arehiteeture is 
to ensure all the team members follow the leader’s speeified trajeetory/states. Consider a network 
with N follower agents that are governed by 

Xi(t) = Axiit) + Buft) + B^ujiit), Xi(to) = Xio, / = 1, .., (1) 

yft) = Cxft), 

and a leader agent that has the dynamies given by 

xoit) = Axo{t) + Buoit) + B^uoit), (2) 

Voit) = Cxoif), 

where matriees A, B, C, B^ represent the agents dynamies matriees and are known, xff) G 
MF, yi{t) G W, Ui{t) G MN, and Ui{t) G W, i = 0,...,N are the agents states, outputs, 
eontrol signals, and exogenous disturbanee inputs. In this work, bounded energy disturbanees 
are eonsidered, i.e. uji{t) G C2, i = 0,..., N (uft) belongs to £2 if < 00). 

In the arehiteeture eonsidered in this paper, eertain and a very few of the followers, that are 
designated as pinned agents, are eommunieating with the leader and reeeive data from it direetly. 
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The other followers are not in eommunieation with the leader and exehange information only 
with their own nearest neighbor follower agents. On the other word, eaeh agent only communieate 
with its neighbors and at least one agent is a neighbour of the leader. The eonsensus error signal 
for the i-th follower is now defined by 


ei{t) = gio{xi{t) - xo{t)) + ^ {xi{t) - Xj{t)), 


(3) 


where gio = 1 if agent z is a pinned agent or is directly communicating with the leader and is zero 
otherwise. When there are no environmental disturbances, i.e. uji{t) = 0, t > 0, i = 0,..., N 
the team reaches a consensus if ei{t) converges to origin asymptotically as f cx). However, 
when there exist environmental disturbances, ei{t) cannot converge to origin, although it should 
remain in a bounded region around the origin. We refer and designate both of these cases as 
achieving consensus through out this paper. 

Based on the above representation for the network, the aim is that all follower agents follow 
the leader agent trajectory. Accordingly, we partition the network Laplacian matrix defined in 

, Lii = 0, L 21 = 0, where L 21 is a iV x 1 vector and 


Subsection 


II-A 


as L = 


"11 


"12 


-^21 L22 

represents the feader’s links to the followers and L 22 is an x matrix and specifies the 
followers’ connections. This will help us to discuss the effects of the leader agent and follower 
agents to reach the entire team objectives. 


C. The Types and Description of the Actuator Faults 

Before formally defining the three fault types that are considered in this work, we let B = 
6^, 6^,..., 6”^ denote the matrix of input channels of the healthy agent, where 6^ denotes the 
k-\h column of the matrix B, B^’^ denote the matrix of the faulty agent with a fault in only the 
/c-th input channel, and denote the matrix of the faulty agent subject to several concurrent 
faulty channels. 

Loss of Effectiveness (LOE) Fault'. For the LOE fault, only a percentage of the generated control 
effort is available to the agent for actuation, therefore the dynamics of the z-th faulty agent after 
the occurrence of a fault at t = tf is modelled according to 

x{ (t) = Ax{ (t) + B^uff) + B^ojff), f > f/, z = 1,..., A^, (4) 

ylft) = Cx{{t), 

where x{(t) G M” denotes the state of the faulty agent, = BTi, Tj = diagjTj’}, for k = 
1,..., m, represents the fault effectiveness of the k-th channel of the z-th agent, 0 < rf < 1 
if the fc-th actuator is faulty, and Tf = 1 if it is healthy. 

Outage Fault'. If the fc-th actuator of the z-th agent is completely lost at the time t = tf, then we 
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have Ui{t) = 0 for t > tj, where Ui{t) = u}{t),... . The dynamics of the Tth agent 

with an outage fault in its fc-th actuator can be represented by 


where = 


x{{t) = Ax{{t) + B^^Uiit) + B^ojiii), t>tf, i = 
y{{t) = Cx{{t), 


(5) 


Stuck Fault : If at the time t = tf the fc-th actuator of the i-th agent freezes at a certain value 
and does not respond to subsequent commands, the fault is then designated as the stuck fault. 
The dynamics of the i-th faulty agent under this fault type can be modelled as 


x{(t) = Ax{(t) + Bu{(t) + B^uji{t), t>tf, i = 
y((t) =Cx{(t), 


( 6 ) 


where u{{t) = u}{t),... ,u'^ \t), ,..., {t) , and uf = u^{tf) for all t > tf 

denotes the value of the stuck command. 

We are now in a position to state the following assumptions. 


Assumption 1 . (a) The network graph is directed and has a spanning tree, and (b) The leader 
control input is bounded and the upper bound is known. 


Assumption 2. (a) The agents are stabilizable and remain stabilizable even after the fault 
occurrence. 

(b) Each agent is equipped with a local EDI module which detects with possible delays and 
correctly isolates the fault in the agent and also estimates the severity of the fault with possible 
errors in the case of the LOE or stuck faults. 


Regarding the above assumptions the following clarifications are in order. First, the Assump¬ 
tions [^(a) and [^(a) are quite common for consensus achievement and fault recovery control 
design problems, respectively. Second, it is quite necessary that in most practical applications 
one considers a leader whose states are ensured to be bounded. Moreover, in practical scenarios 
the actuators are quite well understood and described and their maximum deliverable control 
effort and bound they can tolerate are readily available and known. Therefore Assumptions 
(b) is also not restrictive. Furthermore, in Subsection III-B we analyze the system behavior for 
situations where either Assumption |^(c) does not hold or the estimated fault severities by the 
FDI module are not accurate. We obtain the maximum uncertainty bound that our proposed 
approaches can tolerate. However, as stated in Assumption [^(b), we require the correct actuator 
location as well as the type of the fault for guaranteeing that our proposed reconfigured control 


laws will yield the desired design specifications and requirements. The Scenario 4 in Section IV 
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does demonstrate the consequences of violating this assumption. 

As far as Assumption 2-(c) is concerned, it should be noted that this assumption is indeed quite 
realistic for the following observations and justications. The transient time that any cooperative 
or consensus-based controller takes to settle down and the overall team objectives are satisfied 
is among one of the design consideration and specification for the controller selection. In 
most practical consensus achievement scenarios dealing with a healthy team, the transient time 
associated with the agent response is ensured to be settled down in a very small fraction of the 
entire mission time, and in most cases the healthy transient time takes a few seconds to minutes 
to die out. Therefore, it is quite realistic and indeed practical that during this very short and 
initial operation of the system, the agents are assumed to be fault free. In other words, we will 
not initiate the mission with agents that are faulty from the outset. It is highly unlikely that 
during the very first few moments after the initiation of the mission a fault occurs in the agents. 
For all the above explanations and observations we believe that Assumption 2-(c) is meaningful 
and quite realistic. 


D. Notations and Preliminaries 

For a vector x = [xi,...,Xn^ we define (Euclidean norm ) and L°° norm as 

ll^lli = YJi=i\^iV ll^lb = a/x? H-h a;2, ||a;||oo = max(|a;i|,..., |a;n|). The signal x{t) is 

also represented as x{t) = col{a;j(t)}. The function sgn{a;(t)} is defined as 


sgn{a;(t)} 


T 


sgn{a;i(t)},... ,sgn{a;n(t)} , 


sgn{a;i(t)} 


0 

Xjjt) 

\xi{t)\ 


Xiit) = 0 
Xi(t) 7^ 0 


(7) 


For the vector x the notation diagja;} denotes a diagonal matrix that has diagonal entries x/s. 
The notations In, In and Onxm denote an identity matrix of dimension n x n, a unity n x 1 
vector with all its entries as one, and a zero matrix of dimension n x m, respectively. For a 
matrix X G the notation X >0(X <0)orX <0(X <0) implies that X is a 

positive definite (positive semi-definite) or a negative definite (negative semi-definite) matrix. 
For a matrix A G its 2-norm is defined by 

IIAIU = I sup : X G MA, x ^ 0 

I IfI|2 

The term X~^ (X~^) denotes the generalized left (right) inverse of the matrix X. The terms 
Aj(X), Amin(X) and Amax(2f) denote the f-th eigenvalue, the smallest, and the largest eigenvalues 
of the matrix X, respectively. For the matrix X, ai{X), (Tmin(2f), Umax(2f), denote the i-th 
singular value, the minimum singular value, and the largest singular value of X. The notations 
Im{X} and Ker{X} denote the image and the kernel of X. 
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x{t) = Ax{t) + (8) 

where A is Hurwitz stable and x{t) G is the state vector. The system (|^ is stable if 

||a:(t)||2 CTmaxiPy 

for all x{t) G M” and t > 0, where P is the solution to 

PA + A^P + 2/ = 0. 

Fact 1. For any two matrices X and Y and a positive scaler a we have 

X^Y + Y^X < aX^X + a-^Y^Y. 


E. Problem Definition 

In this work, our main goal and objective is to design a state feedback reconfigurable or 
recovery control strategy in a directed network of multi-agent systems that seek consensus in 
presence of three types of actuator faults and environmental disturbances. Suppose the i-th agent 
becomes faulty and its first mo actuators are subject to the outage fault, mo -f 1 to actuators 
are subject to the stuck fault, while the remaining m — mg actuators are either subject to the 
LOE fault or are healthy. Using equations Q-Q the model of i-th faulty agent that is subject 
to three types of actuator faults can be expressed as 


x{{t) = Ax{ (f) + B{u{ (f) + x{itf) = Xiitf), t > tf, (9) 

y{{t) = Cx{{t), 


B? Bf Bl 

,B? = 

b\. 


,B! = 

yruo+l 

..,b^‘ 

,b: = 

yma+1 

.., 6 ™ 


where Bf = 


Ei = diagjrf}, k = -f 1,.. 


severity factor, u({t) = 

1 T 


0i> 


m 

,s\T 


rf denotes the fc-th actuator effectiveness and fault 


yyy mw 


, M ■ = 


u 


mo-1-1 




Considering the structure of the control law u{(t) and the matrix B(, it follows that only the 
actuators -f 1 to m are available to be reconfigured. Therefore, to proceed with our proposed 
control recovery strategy the model Q is rewritten as follows 


r 


x{{t) = Ax{{t) + Blu\{t) + Blyf + B^ufit), x{{tf) = xfitf), t > tf, (10) 
y{{t) = Cx{{t). 


The main objective of the control reconfiguration or control recovery is to design and select 
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such that the state eonsensus errors either remain bounded and y{ {t) = Hiit), for t > tf, 
when Ui{t) = 0, i = 0,..., N, and the environmental disturbanees are attenuated for Ui{t) ^ 0, 
where y^{t) = yi{t), i = 1,... ^ N, and yi{t) is defined as in equation ([^. 

To develop our proposed reeonfiguration eontrol laws, a virtual auxiliary system assoeiated 
with eaeh agent is now introdueed as follows 


= v4a;“(f)+ 5<(f), a;“(fo) = a;“o, i = (11) 

ytit) = Cxm, 


where x^it) G M"", G and yf(t) G denote the state of the auxiliary system 

eorresponding to the i-th agent, its eontrol and output signals, respeetively. Furthermore, the 
disagreement error for eaeh auxiliary system is also defined as 


- ^o(^))- (12) 

j&J^i 

The auxiliary system that is defined in ( [TT] ) is “virtual” and is not subjeet to aetuator faults or 
disturbanees, and henee it ean be used as the referenee model for designing the reeonfigured 
eontrol laws of the aetual system Q onee it is subjeeted to aetuator faults. 

The Hoc performanee index eorresponding to the z-th healthy agent ([T]) and the z-th faulty 
agent ( [TO] ) is now defined aeeording to 

poo 

Ji= {{Xi{t) - xo{t)y{xi{t) - xo{t)) -+ul{t)uoit)))dt, (13) 
Jto 

poo 

’^1= (14) 

'’if 


where {t) = x{{t) — a;“(f), and 7 and 7 j represent the disturbanee attenuation bounds. Based 
on the above definitions, the team performanee index is now defined by J = Ji- Under 
the eontrol laws Ui{t), i = 1, ..., N, the Tfoo performanee index bound for the healthy team is 
attenuated if J = Xlili Ji ^ ^ ^ 2 - Furthermore, the performanee index for the 
z-th faulty agent is attenuated if j/ < 0 , V ce, G C 2 , i = 0,..., N. It should be noted that the 
performanee indiees ( [T3| ) and (14) are not and eannot be ealeulated direetly as the disturbanee is 
unknown and the aim of the proposed approaeh is to minimize the performanee indiees without 
direetly ealeulating them. 

We are now in a position to formally state the problem that we eonsider in this work. 


Definition 1 . (a) The state consensus Hoc performance control problem for the healthy team is 
solved if in absence of disturbances, the agents follow the leader states and consensus errors 
converge to zero asymptotically, and in presence of disturbances, the prescribed if 00 performance 
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bound for the healthy team is attenuated, i.e. J = — 0- 

(b) Under Assumptions [7] and the Hoc performance control reconfiguration problem with 
stability is solved if in absence of disturbances the state consensus errors remain bounded while 
the output of the faulty agent behaves the same as those of the healthy system outputs, and in 
presence of disturbances the disturbance attenuation bound is minimized and JI < 0. 


III. ifoo Performance Cooperative and Distributed Control Reconfiguration 

Strategy 


In this section, our proposed reconfigurable control law is introduced and developed. Since 
each agent only shares its information with its nearest neighbors, the reconfiguration control 
strategy also employs the same information as well as the agent’s FDI module information. 

Consider the dynamics of the i-th faulty agent is given by (10). As defined above (f) = 
x{{f) — x“(f), with x{{f) denoting the i-th faulty agent state and x“(f) defined in (11), we let 
Zi{t) = C^{(t) to denote the deviation of the output of the faulty agent from its associated 
auxiliary agent output. Then, the dynamics associated with (t) can be obtained as 


a(t) = Ai!(t) + Bin'it) + - B<(i) + t > t,, 

b(() = C?/((). (15) 


Moreover, the faulty agent consensus error is defined as 


(16) 


Lemma 1. The faulty agent consensus error {16) is stable if e^{f) and ^fif) = xfit) — x^{t) are 
asymptotically stable and (f) is stabilized. 


Proof. From the auxiliary error dynamics (15), one can express the state consensus error 
dynamics for the z-th faulty agent that is denoted by e{ {t) according to 


(^) = ( 4 (^) - (^)) + 9io (4 i't)-xo{t)) 

= + {di + gio)^{(t) - ^2 

Therefore if the control law u1 (t) can be reconfigured such that (t) is stabilized then it follows 
that e{ {t) will be stable. This completes the proof of the lemma. ■ 

The above lemma shows that stability of the faulty agent’s consensus error can be guaranteed 
by reconfiguring the control law u^f) such that (f) is stable. This implies that one can 
transform the control reconfiguration problem to that of the stabilization problem. Consequently, 
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in the next two subseetions we eonsider the problem of stabilizing (t). However, as seen from 
( [I^ , the dynamies of depends on the eontrol of the healthy agents. Henee, before presenting 
our proposed eontrol reeonfiguration strategy, the eontrol law for the healthy team (where it is 
assumed without loss of any generality that all the agents are healthy) is presented below. 

In this work, the following general eontrol law strueture is utilized. 


Ui{t) = + K2iei{t) + CioSgn(/fe“(f)), 


(17) 


whieh is the generalization of the one developed in [15| and is given by 

Ui{t) = ciKei{t) + C2Sgn(7fej(f)), 

where ^i{t) = Xi{t) — and e“(f) and ei{t) are given by (12) and (|^, respeetively. 


(18) 


Remark 1. The main challenge in developing the reconfigurable control law in multi-agent 
system as compared to that in single agent is that in single agent control recovery the agent 
is redesigned its control law to maintain its stability. However, in multi-agent system the agent 
should redesign its control law such that the entire team remains stable and loosing one agent 
can cause a disconnected network and failing the entire mission. The main difficulty in the design 
which is not the case in single agent is that each agent only share information with its nearest 
neighbours and communication channels are limited, so that the design should be performed 
using only local information. 


The followings eomments summarize the main eharaeteristies of the eontrol law ( [T7] ) : 

(1) In the eontrol law (17) an agent employs and eommunieates only the auxiliary states x“(f) 
that are unaffeeted by both disturbanees and faults. In eontrast in standard eonsensus eontrol 
sehemes sueh as (18) the aetual states xff) are employed and eommunieated from the nearest 
neighbor agents. Henee, the utilization of ( [TT] ) avoids the propagation of the adverse effeets of 
the disturbanees and faults through out the team of multi-agent systems. This along with the 
degrees of freedom in designing the eontrol reeovery laws allow us to manage the i-th faulty 
agent by only reeonfiguring the eontrol law of the faulty agent, and moreover it also provides 
us with the eapability to reeover simultaneous faults in multiple agents. 

(2) The gain Ku is designed sueh that the states of the z-th agent follow the states of its 
assoeiated auxiliary agent, while the gain K 2 i is designed sueh that the states of the auxiliary 
agents reaeh a eonsensus and follow the leader state. 

(3) Eaeh agent reeeives only the auxiliary agents states in its nearest neighbor set as opposed to 


'The states i = 1,..., N are virtual; however, since ti“(i) depends on the leader state, xlf) also depends on the 

leader state (which is available to only a very few follower agents in the network). Therefore, xf{t) should be communicated 
between the neighboring agents. 
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their actual states that is conventionally required in standard multi-agent consensus approaches. 


(4) The control law (17) is shown subsequently to solve the consensus problem in a directed 
network topology that is subject to environmental disturbances, whereas the control law ( [T8| ) 
solves the consensus problem in disturbance free environment and where the network topology 
is assumed to be undirected . The procedure for selecting and designing the gains of the control 
law ( [T7| ) is provided in Theorem Moreover, the structure of the proposed control law of this 
agent are provided in Figures and 

Theorem 2. The control law Ui{t) = Unit) +Uic{t) solves the performance state consensus 
problem in a team of N follower agents whose dynamics are given by Q and the leader dynamics 
that is given by if Uit{t) and Uic{t) are selected as follows: 

Uit{t) = Kiiii{t) 

Uic{t) = Ui{t) = iT2ie“(f) + Kio{t), 


where e^{t) is defined as in (12), Ku = CiK, K 2 i = C 2 iK, Kio{t) = CioSgn{Ke'}{t)), sgn{.} is 
defined as in K = —B^P, ci = y, and finally the positive definite matrix P is the solution 
to 


A^P + PA- csPBB^P + 2y-^cl^PB^BlP + d^I < 0, 

and C 2 i and C3 are solutions to 

C2LI2 + L22C2 > c^I, C3 >0, C2 = diag{c 2 i} > 0, 

where d^ denotes the number of pinned agents, 7 ^ is the desired disturbance attenuation bound, 
cl^ = max{l, 22 )}, and Cio’s are the solutions to the inequalities 

^ ^ ^ J 1, . . . , 

j&J^i 

where Uqm denotes the upper bound of the leader control signal, i.e., ||Mo(f)||oo < Uqm for all 
t > to. 


Proof. The team reaches a consensus if Xi{t) —>■ Xj{t) —)■ Xo{t). This goal is also achieved if 
agents’ controls are designed such that xft) —)■ x^{t) —)■ 0 ) and x^{t) —)■ Xo{t) (e“(f) —)■ 0 ) 

for i = 1,..., A^. This implies that the consensus achievement problem can be re-stated as the 
problem of asymptotically stabilizing and e“(f) simultaneously. 

In the following, first we discuss the stability criterion and disturbances attenuation for e“(f) 
and in Parts A and B, respectively and then in Part C, we derive the conditions that satisfy 
the requirements for both Parts A and B that in fact solve the performance state consensus. 
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Part A : From ( [TT| ) and (12), the dynamics of e“(t) = col{e“(f)} can be obtained as 

e“(f) = + BoUo{t) + B^uo{t), (19) 

where u°-{t) = col{M“(f)}, A = In ® A, B = L22® B, Bo = L21 ® B, B^i = L21 ® B^. Let us 
select u 1 {t) as M“(f) = iL2je“(t) + CioSgn(iFe“(f)), then the system ( 19 ) becomes 

e“(f) = [A + L22C2 ® BK)e^{t) + {L22C0 ^ B)sgn[[I ® K)e^{t)) + BoUoit) + B^ojoit), 

( 20 ) 


where C 2 = diag{c 2 j} and Cq = diag{cio}. Since the sgn function is discontinuous, in order to 
conduct the stability analysis of the system ( [20] ), it is replaced with its differential inclusion (for 
more details refer to Q, p^ ) representation as follows 

e“(f) /C[(^ + L 22 C 2 ® BK)e°'{t) + {L 22 C 0 ® -B)sgn((J ® iF)e“(f)) + BoUoit) + 

( 21 ) 


where the operator /C[.] is defined as in 0, p4| to investigate its Filipov solutions. Now, we 
require to define the Lyapunov function candidate V (e“(f)) to study the stability properties of the 
error dynamics system. For this purpose, let us select V{e°'{t)) = e“’^(f)Pe“(f), as a Lyapunov 
function candidate for the system (21), where V = In ® P- Also, let K = —B^P, so that the 
set-valued derivative of L(e“(f)) along the trajectories of the system (j^ is given by 


l>(e“(f)) = )C[e'^\t){lN ® {A^P + PA) - (Ca^^L + L22C2) ® PBB'^P)e\t) + 2e“"(f)(/ ® PB) 

(L 21 ® I)uo{t) - 2e^\t){I ® PB){L 22 Co ® /)sgn((/ ® B'^P)e^{t)) + 2ul{t)BlVe^{t)]. 

( 22 ) 


Let Ti(f) = e“'(f)(J ® PB){L2i ® I)uo{t), T2{t) = e^\t){I ® PB){L22Co ® /)sgn((/ ® 
B^P)e°‘{t)), ei{t) = BAPe1{t) and e{t) = col{ei(f)}. Since Ti{t) is a scaler, Ti{t) < ||Ti(f)||i, 
and one has 


Ti(f) < ||Ti(f)|K<||(LT,®/)(J®i?^P)e“(f)||i||wo(f)||oo. 

Then by using the Holder’s inequality 

Tl(f) < ||(LT,®/)||^||(J®pTp)ga^^)||^||^^^^)||^ 

N m 

< 11(1 ® P^P)e“(f)||iMoM = uomY,Y1 


(23) 


(24) 


where e^{t) is the fc-th element of ei{t) = e}{t),, e™(f) 


i=l k=l 


and we use the fact that \\L 


21 CO 
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1. On the other hand, T 2 {t) can be written as 

N 

T 2 (t) = e^(t)(L 22 Co 0 /)sgn(e(t)) = ^T 2 i(t), (25) 

i=l 

where 


T2i{t) = eJ(t)(diCioSgn{ei(t)} - ^ CjoSgn{ej(t)}) 

j&Mi 

m 

= (d*CioSgn{e''(t)} - ^ CjoSgn{eJ(t)}). 

k=l j&Mi 

Let T 2 i{t) = ej^(i)(diCioSgn{ef(t)} —XljeA/-. CjoSgn{e^(t)}), then three cases can be considered 
depending on the value of e\{t) as follows: 

i) ef(f) = 0, then = 0. 

ii) ef(f) > 0, then sgn{ef(f)} = 1. Since Cjo > 0 and sgn{e^(t)} e { — 1,0,1}, it follows that 

diCio - ^ Cjo < diCioSgn{e\{t)} - ^ CjoSgn{eJ(t)} < diCio + ^ Cjo, 
jeM jsM jsM 

and if qo, i = 1,..., are designed such that diCio — Ylj&Mi *^10 ^ 

\d'l{t)\{diCio - ^ Cjo) < T^i{t) < |e*^(f)|(diCio + ^ c^o). (26) 

j^Mi j&Mi 

hi) e^{t) < 0, then sgn{e{(f)} = —1 and e\{t) = —|ef(t)|. Therefore, 


-diCio - ^ Cjo < diCioSgn{e\{t)} - ^ CjoSgn{e^(f)} < -diCio + ^ c^o- 
jeM jeM ieM 

Again if qo, i = 1,..., are designed such that, diCio — XljeM 9 o > 0, then 

|ef(f)|(diCio - ^ Cjo) < T2^i(t) < \ei{t)\{diCio + ^ Cjo). 

jeJ^i jeJVi 


Let T 3 (t) = Ti(f) — T 2 {t). From the inequalities (24)-(27) it follows that 

N m N m 

7 = 1 ^=1 7=1 k=l j^-N'i 

N m 

= EE |e*^(^)l(woM - diCiQ + ^ Cjo). 

i=l k=l j&Mi 

Suppose that C 2 jS and C 3 are obtained such that 

C 2 L 22 + L 22 C 2 > C 3 I, C 3 > 0 , C 2 = diag{c 2 i} > 0 . 


(27) 


(28) 


(29) 
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Now by using the Fact[^for the last term in the right-hand side of (22) with X = 

Y = {In ® Bj^P)e°'{t) and a = ^ 04 , and also the inequalities (28) and (29), the expression (22) 
ean be replaeed with the following inequality 


N m 

t>(e“(f)) < lC[Y^\t){lN®{A^P+ PA-c^PBB'^P))e^{t) + 2 EE \(^i I {^OM diCio p ^ ^ Cjo) 

i=l k=l j&Pi 

2 

+ yC4Wo(^)(^ 21^21 <8) Im)i^o{t) + (f)(/ ® PB^BlP)e'"{t)]. 

Since now the right hand side of the above inequality is continuous, the operator /C[.] can be 
removed. Let = L 21 L 21 and add {t)e°‘{t) to both sides of the above inequality then it 
follows that 

yi.(A{t)) - '^dlciul{t)uo{t) + doe“^(f)e“(f) < g{e^{t)), (30) 

where 


g{e\t)) = e^\t){lN®{A^P + PA-c^PBB'^P + dlI + 2^-‘^cl^PB^BlP))e^{t) 

N m 

+2 EEi (^) I {pOM dpiQ p ^ ^ Cjo) • 

*=1 k=l j&Mi 


From [241, we require g{e°‘{t)) to be negative definite, which will be achieved if P is obtained 
such that 


A^P PPA- c^PBB'^P + 2-f-^c^^PB^BlP P d^I < 0, 
and Cio are selected such that 

uqm diCio P ^ ^ CjQ P 0, i 1,..., X. 

j&Mi 


( 31 ) 


(32) 


Therefore, if Qq, i = 1,..., iV and P are selected as the solutions to ( [3^ and ( [3T] ), the function 
g{.) will be negative definite and for a;o(f) = 0, it follows that l/(e“(f)) < 0, or equivalently the 
consensus errors are asymptotically stable. 

Now, if the initial conditions are set to zero and the disturbance is the only input to the agents, 
then by integrating the left-hand side of ([30]) one gets 


'^0 


(e“ (f)e“(f) - d-c^uj'^{t)uJo{t))dt < 0. 


(33) 


Given that e“(f) = (L 22 ® ^°‘{'t) = x°‘{t) — ljv®a:o(f) and x°‘{t) = col{a;“(f)}, it follows 
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that 


An.r < e“ (t)e“(t) < Am^ (34) 

where Am = Amin(-Z^ 22 -^ 22 ) and Am = Amax(-^ 22 -^ 22 )- Hence, from the inequalities (33) and (34) it 
follows that 

poo _ poo ^2 


'^0 


AmC i't)Cit)dt - I yC4a;o(f)a;o(f)df < 0, 


'^0 


and by selecting C 4 = A^Am one gets 


ItT e\t)eit)dt N 2 
/r^o(^)^o(t)df ^ 2 ^ ■ 


(35) 


Part B : Under our proposed control law the dynamics of the i-th auxiliary agent tracking 
error, can be expressed as 


ii{t) — (A + ciBK)^i{t) + 


(36) 


Consider Vi{^i(t)) = ^J(t)P^i(t) as a Lyapunov function candidate for the system (36) and select 
K = —B^P. It then follows that 


= (l{t){A^P + PA-2ciPBB^P)Ut) + 

and by following along the same steps as in Part A, the above equality can be written as 

Hm) - + PA- 2ciPBB^P + 2j-^PB^BlP + I)Ut). 

Now if P > 0 is obtained such that 


A'^P + PA- 2ciPPP^P + 2-f-^PB^BlP + / < 0, (37) 


then Vi{^i{t)) — < 0 - This implies that for a;i(f) = 0 , we have Vi{^i{t)) < 

0 , and for uJi{t) ^ 0 , one gets 




(38) 


Part C : In order to obtain the positive definite matrix P that satisfies the inequalities ( [3T] ) and 
(37) and also guarantees the disturbance bound attenuation, let us set ci and C 4 as Ci = y and 
€ 4 ^ = max{l, respectively. Given that > 1, it can be observed that if P satisfies 


A^P + PA - csPBB'^P + 2-f-‘^c^^PB^BlP + d^I < 0, (39) 
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then inequalities pT) and (37) will both hold, where C 3 is the solution to (29). On the other 
hand 


1 


N 


1 


N 


- xoit)yixi{t) - xo{t))dt 


i=i '^^0 


i=i '^^0 

^ pOG 

Y 1 / + 2 C{tmmt < 

i=l 

^ POO 

E / (S(tw) +e^(*)e(*)+ &imt)+mifmt 

“ i=l -^to 

^ POO 

i=l >^*0 


2 

1 


Now from equations (35) one has 


N 


N . r .. 7' 


N 


'^0 


= J 2 < y 7 ^ / ujl{t)uo{t)dt = (xUt)uo{t)dt 


i=l -^*0 


' ^0 


i=i '^^0 


and by using (38) 


^ r°° ^2 ^ PC 

E/ 7 w&w*<yE/ 

i=i Jto ^ i=i Jto 


uj {t)ui{t)dt. 


then it follows that 

. N ,„o 


I {Xi{t) - xo{t)Y{Xi{t) - xo{t))dt < yYI I {ujJ{t)ui{t)+uJo{t)uJo{t))dt. 


= 1 ^^0 


i=l 


,2 N 

' I 

i=l “^*0 


Therefore, the team Hoc performanee upper bound ean be expressed as 

T.tl ~ Xo{t)y{Xi{t) - Xo{t))dt ^ 2 

E *=1 + u;o(t)u;o(t))dt ~ ^ 

The above inequality implies that J < 0, or equivalently the healthy team Hoc performanee 
eriterion holds. This along with the properties of the stability of e“(f) and as stated in 
Parts A and B, imply that our proposed eontrol law solves the H^o performanee state eonsensus 
problem for the healthy team. ■ 


A. Hoc Performance Control Reconfiguration 

Consider the representation of an agent subjeet to presenee of faults be speeified as in 


Subseetion II-E and given by the equation (10) or equivalently by the transformed model (15). 
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yl(t) ul(t) u-(t)yf(t) 2/“(t)«“(i) 


Figure 1: The sehematie of the z-th pinned agent and its nearest neighbor agents j and k, 

whieh are not pinned. 




Xi(t) 


1 . 



Figure 2: The z-th agent eooperative control structure and its associated auxiliary system 
control laws, where ^i{t) = Xi{t) — x^{t) and ef{t) is defined in ([T^. 


Our proposed reconfigured control law for the z-th faulty agent is now given by 

<(t) = Ku(I (t) + KliuKt) + vS, ( 40 ) 

where are control gains and wf is the control command to be designed later. Therefore 

the dynamics of the closed-loop faulty agent ( [T?] ) becomes 

U(t) = + + + ( 41 ) 

Zi{t) = C^{(t). 

As per Definition the Hoc control reconfiguration objectives can now be stated as that of 

selecting the gains and the control command such that (a) [t) is stable, (b) 

foo (t)dt 

Zi{t) = 0 (that is, y({t) = yf{t)) for Ui{t) = 0,t>tf, and (c) 


< 7 | for Ui{t) ^ 0. 
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In order to pursue the reeonfiguration strategy we required the following assumption, we later 
diseuss how deviation of this assumption affeet the results. 

Assumption 3. Under the fault scenario, there still enough actuator redundancy to compensate 
for the fault, i.e. 


B‘ii c (42) 

then there exists a eontrol signal n? sueh that 

= 0. (43) 

Subjeet to the above eondition, equation ( |4T] ) now beeomes 

Hit) = (A + BlKlXl(t) + (BlKi,-B)u1{t) + BM(t), (44) 

2iV) = 


Let us temporarily assume that ojft) = 0, then 

Ziit) = -5)<(s)ds. (45) 


From (45), to ensure that the outputs of the faulty agent do not deviate after fault, both terms 


should be zero or negligible. The first term will be negligible if the agents reaeh a eonsensus 
before fault oeeurrenee i.e. (fj) ~ 0 or if Kl^ is designed sueh that damps 

very fast. This ean be aehieved easily if \max{^ + is small enough. On the other 

hand, aeeording to Theorem+ Kio{t). Given that the eontrol gains 
are designed sueh that e“(f) is asymptotieally stable and Kiof) is bounded, u^f) also remains 
bounded. Considering that u^it) does not depend on the dynamies of (t), it ean be treated 
as a disturbanee to the system ( [44] ). Consequently, the problems of (i) enforeing Zi{t) = 0 (for 
t > tf, 0 Jj{t) = 0, j = 0,... ,N and any M“(f)), and (ii) stabilizing {t), is similar to that of 
the disturbanee deeoupling problem with stability (DDPS), as studied in p7| . 

The geometrie approaeh that is based on the theory of subspaees Q is the most popular method 
for solving the DDPS problem. Towards this end, we first introduee the required subspaees as 
follows: = Im{i?[}, C = Ker{(7}, V* and V* denote the maximal {A, Bl) eontrolled invariant 

subspaee that is eontained in C, and the maximal internally stable {A,Bl) eontrolled invariant 
subspaee that is eontained in C, respeetively. 

Following the proeedure in Q, if and are seleeted sueh that 


\m{BlKli - 5} c V*, (A + C V* 


(46) 
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then the seeond term in (45) will also vanish. On the other hand, if seleeted 

sueh that 


lm{BlK;, -B}cV;,{A + BlKl)V; C v;, (47) 

then the seeond term in (451 will also vanish and (t) will be stable due to the stability of the 
subspaee V*. Unfortunately, there is no systematie approaeh to explieitly obtain V*, implying 
that V* eannot be eomputed and employed direetly for obtaining that satisfies the eondition 
0 . Therefore, we are required to transform the eondition ( |47| ) into a verifiable one. Onee sueh 
a eontroller is obtained, one ean then ensure that Zi(t) = 0 and (t) will remain stable. 

Given that V* is {A, B^) eontrolled invariant, there exists a matrix a friend of V*, Q 
sueh that AcV* C V*, where Ac = A + BlKl^. Now, by invoking the Theorem 3.2.1 of Q, for 
a matrix Ac and its assoeiated V*, there always exists a nonsingular transformation T sueh that 


Ac = T-^AcT = 


0 A? 


(48) 


where T = 


Ti T2 


, Im{Ti} = V* and T 2 is any matrix that renders T nonsingular. By 


substituting Ac = A + B^K{^ into (48), it follows that 

A, = A+ b:k[^, 


where A = T ^AT = 


partitioned as K^- = 
sueh that 


i4-ll -4 i2 




, = 


^21 ^22 


[Bl^] 


T^rl T^r2 


(49) 


and KL = KLT. Now, if KL is 


, from (|48|) and (|49|) it ean be eoneluded that there exists KA 


A 21 + = 0 


Furthermore, under the transformation T, the system (44) ean be re-written as 

|/(f) = Ac^Ut) + E.um + BM{t), 

Zi{t) = 


(50) 


where (f) = T (f), Ac = 


-left 


Ai A? 


, = in + = ii 2 + i3 = 


- b; 


'b^ 


P -| 

, B = T-^B = 

,C = CT = 

0 C 2 

BhKl, - B 2 


B2_ 




0 i3 

/I22 + E, = BlKi, -B= 

B^ = T~^B^. We are now in a position to state the main result of this subseetion. 

Theorem 3. Consider a team that consists of a leader that is governed by ^ and N follower 
agents that are governed by 0. and their control laws are designed and specified according 
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IS now 


to Theorem^ Suppose at time t = tf the i-th agent becomes faulty and its dynamics is 
governed by ( [70| ) where Assumption^also hold. The control law ( pO] ) solves the Hoc performance 
control reconfiguration problem with stability where the Hoc upper bound is given by yj = 


a if yy is obtained as a solution to {43), ^ Y 2 X, 


K 2 i is the solution to 


--1 


- 52 = 0 , 


T and 


(51) 


where T is defined in ( |4S] ), Xj and Yfs, i = 1, 2 are solutions to 

< 0, X = <i/a^{Xi,X2} > 0, y42iXi + BI 2 Y 1 = 0, (52) 


max a s.t. 


0 X 
X -I 


where 0 = 


01 02 
0.2 


, 01 = XiA[i + YfBll + AnXi + 5[,Xi + aBlB^J, 02 = A 12 X 2 + 


%Y 2 + aBlB^\ 03 = X 2 AI 2 + Y^Bll + ^ 22 X 2 + B 2 Y 2 + aBlB^J, An, A 21 , An, B^ and 


Bi 2 are defined as in {49) and B^ and B 2 are defined as in {50). 


Proof. Consider the system (50). Given that the two inputs uifit) and u^f) are bounded and 


independent from each other, one can investigate their effects separately. Therefore, the proof is 
provided in three parts, namely: in Part A we assume that ujfit) = 0 and the set of all control 
gains that guarantee zff) = 0 and stabilize (t) are obtained. Next, in Part B we assume that the 
disturbance is the only input to the agent and obtain the gains that minimize the performance 
index and guarantee stability as well. Finally, in Part C, the control gains that satisfy both Parts 
A and B are obtained. 

Part A : Let ufit) = 0 so that we have 

dm = +£■,<((), 

Zj(i) = (??/(;)■ 

Since Ac is an upper-triangular matrix, the matrix is also upper-triangular and can be 


written as = 


(^/) = 0 can be written as 


.Alt 


m) 

..Alt 


, where F 2 {t) = Under Assumption 


2,(i) = / - B2)u“(s)ds. 


(c), 


(53) 


If XJj is obtained such that 


BI 2 KI 2 , - 52 = 0 , 
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then Zi(t) = 0, which implies that the above condition is equivalent to (46). Moreover, if K[l 
and Klf are selected such that An + and A 22 + B^ 2 ^ii Hurwitz, then Ac will also 

be Hurwitz. Given that is bounded and Ac is Hurwitz, then ^i(t) will also be bounded. 
Therefore, condition (47) is equivalent to obtaining the matrices Klf and such that 


+ Bl,Kll = 0 , 


li 
^rl 


All + BhKll is Hurwitz, 
A 22 + Bl 2 Kl^ is Hurwitz, 
Bl,Kl^ - 52 = 0 . 


(54) 

(55) 

(56) 

(57) 

(58) 


Part B : Let the agents be only affected by the disturbances, then we obtain 

l/(^) = Aci({t) +B^uji{t), 

Zi{t) = 

Consider a Lyapunov function candidate V/{^- (t)) = {t)P^- (t), where P = diagjPi, P 2 } > 

0. The time derivative of V/(t) along the trajectories of the system (58) is given by 

V/{t) = ^f{t){AlP + PAc)U{t) + 2Cf{t)PB^u;At). 

By applying Fact to the second term in the right hand side of the above equation with = 

— p'Y — — _ 

{t)PB^, Y = Ui{t) and a = 7 “^, and adding to both sides one gets 


v/{t) - + il' im {t) < e/' {t)A^!{t), 


(59) 


where 


A = 


Tf Pi + P,Ai 

P,T2 

+ 7“' 

PiPiPiVi PiBlB^JP2 

Afp, 

AfP2 + P 2 AI 

P2BlB^JPi P2BlB^JP2_ 


and PA and PA are such that B,,, = 


pA 


+ 


. If the matrices Pi and P 2 are obtained such that 


A = 


Ai"Pi + PiAl 
AfPi 


PiAl 


AfP2 + P 2 AI 


+ 7 


-2 


PiBlBlPi P1BIBIP2 

P2BlB^JPi P2BlB^JP2 


+ / < 0 , (60) 


then the right hand side of ( [5^ will be negative definite and we have 

V/{t) - 7 V^(f)a;i(f) + {t)i{(t) < 0. 
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Consequently, by integrating both sides of the above inequality, one gets 


mm 


< r 


Now, given that {t) = T {t), the performanee bound for {t) ean be obtained as 






< YKLiT-^T-^) = Yf 


Part C : From Parts A and B, it follows that Kl} should satisfy (54) and (55), should 


satisfy ([5^ and iFJi should satisfy ([57|), while the inequality ([^ should also hold. Note that if 


there exist matriees Pi and P 2 sueh that (60) holds then Ac will be Hurwitz. This implies that if 


the inequality (60) holds then (55) and (56) will hold. Therefore, the problem is redueed to solving 
the equality (57) for K^i and solving (54) and (60) simultaneously for Kll and Klf. Equation 


([57|) is linear with respeet to be solved easily, whereas eonsidering the strueture of 


A* for i = 1,2,3, the inequality (60) is nonlinear with respeet to Pi, P 2 and 7. However, by 
multiplying both sides by P~^ and using the known ehange of variables X = diag{Xi,X 2 }, 

a = 7 


Xi = Pfi, X 2 = P^K Yi = KllP{\ Y 2 = kl^P^^ 


^ and using the Sehur eomplement. 


the inequality ( [60| ) ean be transformed into the following LMI eondition: 

< 0 , 


0 

X 


X 

-I 


(61) 


where 0 = 


01 02 
0T 0,3 


, 01 = XiA^, + + ^^^Xi + Bl^Yi + 02 = A 12 X 2 + 


BI^Y 2 + oiB^bT^ 03 = X 2 A \2 + Y^b77 + A 22 X 2 + B 2 Y 2 + aBlB77. Therefore, the eontrol gains 


Kll and Klj satisfy the requirements of Parts A and B if the solutions to the inequality (61) 


also satisfy (54). These requirements ean be aehieved provided that the gains are obtained as 
solutions to the following optimization problem, namely 


max Oi s.t. 


0 X 
X -1 


<0, X > 0, A 21 X 1 + &^Yi = 0. 


Subjeet to the above eonditions the upper bound for the Poo performanee index and the reeon- 
figured eontrol gain are now speeified aeeording to 7 ^ = and = 

YiXf ^ ^ 2 ^ 2 ^^ and this eompletes the proof of the theorem. ■ 

The following algorithm summarizes the required steps that one needs to follow for designing 
the reeonfigured eontrol law gains. 

Algorithm for Design of the Fault Reconfiguration Controller Gains: 
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1) Obtain the maximal (A, i?[) controlled invariant subspace, V*, either by using the iterative 
algorithm that is proposed in ^ or by using the Geometric Approach Toolbox (available 
online). Set Ti such that V* = Im{Ti} and select T 2 such that T = Ti T 
matrix. 

2) Obtain An, A 21 , A 12 , Bn and Bi 2 as in (|4^ and and B 2 as in (Is^. 


is a nonsingular 


3) Solve the optimization problem ( [52] ) for Xi,X 2 , Yi and Y 2 . 

1 


4) Set Kn as = 


FiXf' y2X 


-1 


T- 


5) Solve equation (511 for X 2 j. 

6) Solve equation (43) for uf. 

7) Set uUt) = Kl £{(() + /<■,>“(() + mF. 


8) Set u{ {t) = 


0i> 


(utr 




In view of Theorem [^ and the above Algorithm the following results can be obtained imme¬ 
diately. 


Corollary 1 (Presence of only the LOE fault). Suppose the actuators are either healthy or 
subject to the LOE fault. In this case, Bj in (49) is given by Bj = BVi, where Tj = diag{V^}, 
fc = 1,..., m. Furthermore, the faulty control law u{ {t), and the reconfigured control law, u^it), 
for the i-th faulty agent are designed according to 


dV) = K(<) 

K(«) = A’K/ (() + 


where the control gains and are designed according to the Steps 4 and 5 of the above 
algorithm. 


Corollary 2 (Presence of only the outage fault). Suppose the actuators 1 to ruo are subject to 
the outage fault and the remaining actuators are healthy. In this case, Bj in ( |?9| ) is given by 
. . Furthermore, the faulty control law u{ {t), and the reconfigured control 


b: = 


ynio+l 


law, vj (t), for the i-th faulty agent are designed according to 


{t) = 


Olx mo 
/ 


{umy 




where the control gains K[^ and are designed according to the Steps 4 and 5 of the above 
algorithm. 


Corollary 3 (Presence of only the stuck fault). Suppose the actuators 1 to rUg are subject 
to the stuck and the remaining actuators are healthy. In this case, Bj in (49) is given by 
Bj = ... . Furthermore, the faulty control law u{{f), and the reconfigured control 


DRAFT 























25 


law, ul (t), for the i-th faulty agent are designed according to 

d(t)= (a,*)’’ (K(t)Y , 

where the control gains and are designed according to the Steps 4 and 5 and the control 
command uf is obtained according to the Step 6 of the above algorithm. 

Similar results corresponding to the combination of any two of the considered three types of 
faults can also be developed. These straightforward results that follow from Theorem and the 
Corollaries [T](^ are not included here for brevity. 


B. The Existence of Solutions and Analysis 

In the previous two subsections, two cooperative control strategies to ensure consensus achieve¬ 
ment and control reconfiguration in multi-agent systems subject to actuator faults and environ¬ 
mental disturbances are proposed and conditions under which these objectives are guaranteed are 
provided. In the following, we discuss the properties of solutions if certain required conditions 
are not satisfied. We consider five cases that are designated as I to IV below. 

Case I : If the Assumption [^(c) does not hold, i.e., the fault occurs during the transient period. 


then [tf) 7 ^ 0, and the first term in (451 will be non-zero. However, since is designed such 
that A A is Hurwitz this term will vanish asymptotically. Note that the delay in receiving 

the information from the FDI module and activating the control reconfiguration will also result 
in (tf) 7 ^ 0 , and causes a similar effect. 


Case II : If B 2 Im{i?[ 2 }, then (51) does not have a solution. In this case, we may obtain 
A' 2 j as a solution to 

min trace{5[2iT2i - ^ 2 }. 


I\ r) 


Corresponding to this choice of the second term of ( [45| ) will remain non-zero and we have 
Zi(t) 7 ^ 0 but bounded. However, if is designed according to Part B in the proof of Theorem 
1 ^ one can still guarantee boundedness of the state consensus errors. 


Case III : Suppose that equation ( [43| ) does not have a solution, which is the case if 
the estimated value of the stuck fault command, that is uf, is not accurate, or if Assumption]^ 
does not hold or both. For generality, suppose that yf is not accurate and condition ([42]) does 


not hold. In this case uf = Ui+ e*, where and e* denote the estimated then equation (43) can 
then be expressed as 

+ B'vY) + B-c, = 0. 


Since e* is unknown, therefore to obtain uf we instead use the following optimization problem. 
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namely 

min trace{i?j^M* + Bluf}. 

Let T]i = {B-u^ + B^uf) + Bfei- Consider the eontrol law (40) as designed in Theorem It 


follows that for uji{t) = 0, equation (44) beeomes 

il (<) = + {B'Kii - B)u1{t) + 1 ,, 


where Ac = A + For as a solution to (51), it follows that 


z,{t) = - IH. 

Given that Ac is Hurwitz, the above equation implies that after a transient period the error between 
the output of the faulty agent and its assoeiated auxiliary system, or equivalently the output 
traeking error reaehes a eonstant steady state value, i.e. lim^^oo Zi{t) = —CA~^rii. Consequently, 
under this seenario one ean still observe that the state eonsensus errors remain bounded. 

Case IV : Let the estimated aetuator loss of effeetiveness faetor or severity be subjeet to 
uneertainties, i.e. = Ff + ef, where Ff is the estimate of the fault severity that is provided 


by the FDI module, and ef is an unknown estimation error uneertainty. Consider equation (49). 
Sinee F^ ^ we have B^ = B; + where 4" = T-^B^ATi, = 

diagjef}, k = + 1,..., m and B(^ = 5"^^+^... ^ 5™ . In order to analyze the impaet of 

these uneertainties on our previous results, we need to investigate both the matehing eondition, 
namely equation (plj), and the stability of the traeking error (f). 


Sinee T, is unknown, one eannot determine the gain K^i sueh that (51) holds. This implies 


that unlike (53) one eannot ensure Zi(t) = 0. On the other hand, Ac in (50) should be replaeed 
by 


Ac = Ac + Al = A + BlKl, + 


“■ li * 


III-A 


for now Ac = A + B^KL, 


Following along the same steps as those utilized in Subsection 

one can obtain the control gain that makes Ac Hurwitz. Hence, for cji(t) = 0, equation (50) 
can be written as 

In order to utilize the results in Theorem we rewrite the above equation as follows 

W = A?/W + +/(?/W). 

where /(([ (i)) = .4^/ (t). Given that A’ = Eiim.+i we get 


11-4:112 < y; 


eWk%, 
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where ^ and denote the I — eolumn of and the I — rUg row of respeetively. Now, 

by using Theorem if there exist ej^nax > 0, Z = 1,..., m — sueh that 


/=r72s + l 


1 

Crmin(^)’ 


(62) 


and |e*| < then the matrix Ac remains Hurwitz, where P is a positive definite matrix 
solution to 

PAc + AlP = -2L 


This along with the boundedness of M“(f) implies that ^{{t) will also remain bounded. 

Case V : Suppose that the fault is reeovered after a delay of A s, i.e. U = tf + A, where 
tf and tr denote the time that the fault oeeurs and the time that the eontrol reeonfiguration 
is invoked. During the time tf<t< U, the traeking dynamies of the i-th agent, i.e., (t), 

beeomes 

a (() = (A+ c,b!KU{ (t) + (B/ - B)ut(t), tf<t< u. 


Therefore, one gets 

x{{t) = exp((A+ciP/P)(f-f/))(a;i(f/)-a;“(f/))+ [ exp((A+ciP/P)(f-s))<(s)ds+a;“(f). 

Jtf 

If the fault eauses A + ciP /K to beeome non-Hurwitz, then x{{t) will grow exponentially. 

Now, let xf^ denote the maximum allowable upper bound on the agent’s state (this ean be 
speeified for example based on the maximum speed of the moving agent or the maximum depth 
for surveying under the water), then invoking the reeonfigured eontrol law eannot be delayed 
beyond As, where the maximum delay in invoking the reeonfigured eontroller is denoted by A 
and ean be obtained by solving the following equation: 

pty H-A 

= a;-(f/+A)+exp((A+ciP/ K)A){xi{tf)-xAtf))+ / exp((A+ciP/P)(f/+A-s)X(s)ds. 

This implies that if the fault is not reeovered before t = tf +A s, the faulty agent may no longer 
be reeoverable to satisfy the overall mission requirements and speeifieations at all times. 


IV. Simulation Results 

In this seetion, our proposed eontrol reeovery approaeh is applied to a network of Autonomous 
Underwater Vehieles (AUVs). The team behavior is studied under several seenarios, namely when 
the agents are healthy and also when the agents are subjeet to simultaneous LOE, outage and 
stuek aetuator faults, uneertainties in the EDI module information and delays in invoking the 
eontrol reeonfiguration. The team is eonsidered to eonsist of five Sentry Autonomous Underwater 
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Vehicles (AUVs). Sentry, made by the Woods Hole Oceanographic Institution [12|, is a fully 


autonomous underwater vehicle that is capable of surveying to the depth of 6000 m and is 
efficient for forward motions. 

The nonlinear six degrees of freedom equations of motion in the body-fixed frame in the 
horizontal plane is given by Q: 

Mz> + C{u)u + D(i/, (pf)]/ -f g{ri) = h), 

f] = 

where M, C, D and J denote the inertia matrix, the moment/forces matrix, the damping matrix 
and the transformational matrix, respectively. The terms g{r]) and h) denote the hydrostatic 
restoring forces and the truster input, respectively, and are given by 


h) = 


{hfp -f hfs) COS(j)ff -f {hap + has) COS(j)af 


0 

0 


0 

{hfp hfs) sin -f {hap T has) sinc^^/ 

, giv) = 

0 

bt{hfp - hfs)sm(j)ff + bt{hap - has) sin(j)af 

Zbg cos 6* sin (j)W 

“®//(^/p + ^fs) sin 0 // - aaf{hap + has) sm 0^/ 


Zbg sin^IF 

bt{hfp- hfs) COS(()ff + bt{hap-has) cos (j)af 


0 


where 0 / = [ 0 // 0 a/]^ and h = [hfp hfg hap hasY denote the foil angles and the truster inputs, 
respectively. The term g = [ 77 ^^ where gi = [x y denotes the inertial position and 
V 2 = [<t> d ipy denotes the inertial orientation. Also, u = [vj , with ui = [u v denotes 
the body-fixed linear velocity and h >2 = [p q rY denotes the angular velocity. Finally, zbg and 
W denote the vertical distance between the center of the buoyancy and the center of the mass 
and the vehicle weight, respectively. 

For the Sentry vehicle, the horizontal position is controlled indirectly through the heading 
subsystem, i.e. v, r, ijj, and surge speed subsystem, i.e. u. Therefore, for control purposes the 
states X and y are ignored. Moreover, under the assumptions that (a) the truster and foil angles 
do not affect each other, (b) the pitch and the pitch rate, i.e. 9 and q are sufficiently small, 
and (c) the foil angles are sufficiently small, then the states p, 0 are also ignored for control 


design and are considered passive [12|. Therefore, for the control design in the near horizontal 
maneuver under the operating point z/° = [m° 0 w°Y 


^2 = Osxi g° = Ogxi, the linear model 
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of the Sentry AUV is reduced to the following subsystems: 


■/(f)' 


aiiu° 

0 

0 

O' 





mil 

mil 

mil 

mil 


'hfp{ty 

v{t) 


0 

a22U° 

a2GU° 

0 


v{t) 

+ 

m2Gbh 

-m2Gbh 

m2Gbh - 

m2Gbh 


hfg{t) 

r(f) 


0 

aG2U° 


0 


r{t) 

fTlAh 

-mGebh 

m^G^bh — 

me^bh 


hapit) 

JPit). 


0 

0 

1 

0_ 





0 

0 


0 

0 


.has (f). 

'w{t)' 


a33U° 

a3GU° 

0 - 

T^m33ZGBW 




An 





Qit) 


Q‘33u° 

a55U° 

0 - 

-niGGZGBW 


(lit) 

+ 



(t>ffit) 



i(f) 


1 

0 

0 

U° 



z{t) 

0 

0 


Afit)_ 

5 


.m. 


0 

1 

0 


0 



At). 


_ 0 

0 _ 






where = i^^32 + {u°ff32, af = + {u°ff5i, and 


aP = 


1 

l+/3h, 


^52 + (m°)^/ 52 - The detail relationships between the above parameters and the system 


parameters are provided in [12|. 

For underwater vehicles, the ocean current is considered as a disturbance to the system, i.e. 
u{t) = Vc{t), where 14(f) denotes the ocean current. In 0, the ocean current is modeled by a 
first order Gauss-Markov Process as governed by 14(f) + /il4(f) = v{t), where /i > 0 and v{t) 
is a Gaussian white noise. For /r = 0, the model becomes a random walk, i.e. 14(f) = v{t). 
Therefore, the disturbance signal that is applied to the z-th agent is expressed as uji{t) = Vci{t) = 
Jlvi{t)dt + Vci{to). 

In conducting our simulations we only consider the speed-heading subsystems, i.e. u, v, r, 'ijj- 
To obtain a linear model, the forward (surge) speed u° is set to = 1 and all the parameters are 
considered to be the same as those in in], 0. The numerical values of the triple (A, B, C) 
for the z-th agent is governed by 



■-0.0401 

0 

0 

o' 


'0.44 

0.44 

0.44 

0.44 ■ 

A = 

0 

-0.709 

-0.648 

0 

, B = l.Oe - 03 

0.06 

-0.06 

0.06 

-0.06 


0 

-1.770 

1.414 

0 


0.49 

-0.49 

0.49 

-0.49 


0 

0 

1.00 

0 


0 

0 

0 

0 


B^ = 


0.023 0.017 0.03 0 


C = 


0 0 
T 


, Xi{t) = Ui{t) Vi{t) ri{t) 


Uiit') hijp(t^ h.j(jp(f) hiag(t^ 

The network topology considered is as shown in Figure The leader control law is selected as 
zzo(f) = KoXo{t)+For{t), with Kq = 1.0e-l-04[/coi; ^ 02 ; hs; koi], koi = [-0.52, -3.5, -0.65, -8.0], 
ko2 = [-0.22,-0.19,0.39,0.48], fco3 = [-0.04,3.48-0.04, 6.47], A:o4 = [-0.25,0.17,0.45,1.19], 
and Fo = 1.0e-f03[/oi; / 02 ; /os; / 04 ], /or = [3.02, -0.14, 0.36, 6.53], /02 = [-0.14,4.02, -1.93, -2.46], 
/os = [0.36,-1.93,-1.55,3.61], /04 = [6.53,-2.46,3.61,-9.55], and the desired leader speed 
r(f) = Mdesired(f) is defined according to Figure]^ The objective of the team cooperative control 
is to ensure that all the agents follow the leader output (surge speed) trajectory, while their yaw 
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Figure 3: The topology of the leader-follower network of given AUVs. 


angle, sway and yaw rate remain bounded. The aeeeptable errors between the desired trajeetory 
and the aetual trajeetories are eonsidered to be less than 10% in the steady state. The following 
seenarios are now eonsidered: 

Scenario 1: Faulty team without eontrol reeonfiguration: In this seenario, it is assumed that 



Figure 4: The desired leader surge speed trajectory. 

no control reconfiguration is invoked after the occurrence of the faults. The specifics for the 
mission considered are as follows where the followers state trajectories are depicted in Figure 

El 

A) All the agents are healthy and the agent control law is designed according to Theorem 
1^ and using YALMIP toolbox [?] for MATLAB. The gains are obtained as Ci = 3.926e + 
06, K = 1.0e03[ki;k2;k3;h], ki = [-0.23,0.169, -0.275,-0.039], fca = [-0.26,-0.175, 
0.278,0.031], ks = [-0.23,0.169,-0.497,-0.039], k^ = [-0.026,-0.175,0.278,0.031], C 2 = 
l.Oe + 07diag{1.23,1.39, 0.39,1.48} and the H^o upper bound is computed to be 7 = 0.3687. 

B) At time t = tj = 25 s, the agents 1 and 2 become faulty. Agent 1 loses its second actuator 

i.e. = 0,t > 25. Agent 2 loses 30% of its first actuator and its second actuator gets stuck 

at U 2 = 1, i.e. = 0.7/i2/p(f) and = 1 for f > 25 s. 

Figure clearly shows that if a reconfiguration control strategy is not invoked, the agents 
become unstable and their states grow exponentially unbounded. Therefore, it is necessary to 
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reconfigure the agent’s control law after the occurrence of this fault. 



Time [s] 


20 25 

Time [s] 


-Agent 1 
-Agent 2 
-Agents 
Agent 4 


Figure 5: The followers trajectories corresponding to the Scenario 1. 


Scenario 2: Control reconfiguration subject to delays in invoking the reconfigured control law: 
Unlike the previous scenario, in this scenario control reconfiguration laws are invoked to the 
faulty agents. However, it is assumed that there are delays in the time that the FDI module 
communicates this information to the faulty agents and the agents reconfigured controls are 
invoked. The specifics for the execution of the mission are as follows where the followers state 
trajectories are depicted in Figure 

A) All the agents are healthy and the agent control law is similar to the Scenario 1. 

B) At time t = tf = 25 s, the agents 1 and 2 become faulty. The fault scenario that is considered 
is the same as that of Step B) in Scenario 1. 

C) The control laws for both faulty agents are reconfigured according to Theorem at 1 = 

U = 30 s and are set as Kl^ = 10e03[/ciii; fcii 2 ; fciis], kni = [2.627,0.090,-1.895,-4.328], 

= [-2.058,0.09,0.293,3.034], fens = [-0.7549,-0.1799,0.8115,0.4458], 

K^2i = [^211, k2i2, k2i3], k2ii = [0.50,0.00, 0.50, 0.00], ^212 = [0.50, 0.00, 0.499, -0.00], ^213 = 
[0.00,1.00,-0.00,1.00] and = 10e03[A:i2i; ^ 122 ; A:i 23 ], k^i = [0.113,0.130,-0.485,-2.89], 
ki22 = [0.881,-0.089,-1.263,0.664], k^23 = [-0.969,0.18, 0.697,0.4], = [^ 211 ,^ 212 ,^: 213 ], 

^211 = [0.7140,0.00, 0.7143,0.00], ^212 = [0.50, 0.00, 0.499, -0.00], ^213 = [0.00,1.00, -0.00,1.00] 
and 

Figure depicts that by invoking the reconfigured control laws one can now stabilize all the 
agents. The delay in invoking the control reconfiguration causes a transient period in which the 


agent states diverge and will not follow the leader (refer to discussion in Subsection III-B Case 


V). However, after the transients have died out, the agent reach a consensus with the leader state. 
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Time [s] 


Figure 6: The followers trajeetories eorresponding to the Seenario 2. 


Scenario 3: Control reeonfiguration subjeet to fault estimation uneertainties: In this seenario, 
we consider a similar fault scenario as in the previous scenarios. However, it is assumed 
that the estimated fault severities are subject to unreliabilities, errors and uncertainties. Using 


the inequality (62) the upper bound on uncertainties is obtained as = 0.146, implying 


that the reconfigured control law stabilizes the errors provided that it is designed based on 
0.554 < r 2 — 0.846. To investigate how accurate this range is, various levels of uncertainties 
and mismatches are considered and it is observed that the control gains that are designed 
for r 2 < 0.86 stabilize the errors whereas for T^ ^ 0.87 the state consensus errors become 


unstable . This indicates that the bound provided by the inequality ( [62| ) provides an acceptable 
approximation to the maximum allowable fault severities estimation errors and uncertainties. 
The agents state simulation responses correspond to T^ = 0.6 and = 0.9, and are depicted in 
Figure |7J 

Figure |7] shows that by invoking the reconfigured control law, the agent states will no longer 
diverge and the recovery control strategy stabilizes the agent states. In fact, in this scenario 
the agents do follow the changes in the leader speed trajectory, although the error between 
the faulty agent speed trajectory and the leader speed trajectory will not vanish but converges 
asymptotically to a small constant value. 

Scenario 4: Control reconfiguration subject to uncertainties in the fault isolation: In this sce¬ 
nario, the effects of uncertainties in the fault isolation decision made by the FDI module are 
studied. It is assumed that the FDI module of agents 1 and 2 are subject to fault isolation 
uncertainties. Two cases are considered as follows: 
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Figure 7: The followers trajeetories eorresponding to the Seenario 3. 


Scenario 4.1: 

A) Similar to Step A) in the Seenario 1. 

B) At time t = 20s the FDI module launehes a false fault alarm for the agent 2, that the seeond 
aetuator gets stuek at U2 = 1 and its first aetuator loses 30% of its effieieney. Then, a reeonfigured 
eontrol is invoked to this agent. 

Scenario 4.2: 

A) Similar to Step A) in the Seenario 1. 

B) At time f = 20 s agent 2 beeomes faulty and a fault seenario similar to Step B) in the 
Seenario 1 oeeurs. However, the FDI module does not detect and isolate this fault in the agent 
2 and instead the FDI module wrongly initiates a fault alarm and a reconfigured control that is 
applied to the agent 1. 


V. Conclusions 

In this work, cooperative and distributed reconfigurable control law strategies are developed 
and designed to control and reconfigure faulty agents from three types of actuator faults, namely 
loss of effectiveness, outage, and stuck faults that guarantee boundedness of the state consensus 
errors for a network of multi-agent systems. It is shown that the proposed control strategies can 
ensure an Hoc performance bound attenuation for the team agents when they are subjected to 
environmental disturbances and actuator faults. Our proposed reconfigured control laws ensure 
that the output of the faulty agent matches that of the healthy agent in absence of disturbances. 
Moreover, the control laws also guarantee that the state consensus errors either remain bounded. 
Furthermore, in presence of environmental disturbances the ifoo disturbance attenuation bound 
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is ensured to be minimized. The effeetiveness of our proposed eooperative eontrol and reeonfig- 
urable approaehes are evaluated by applying them to a network of five autonomous underwater 
vehieles. Extensive simulation ease studies are also eonsidered to demonstrate the eapabilities and 
advantages of our proposed strategies subjeet to EDI module uneertainties, erroneous deeisions, 
and imperfeetions. 
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